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How Much Does the Pre-K CLASS Relate to 
Children’s Readiness for School Skills? 


Key findings 


- Classroom scores on the Pre-K CLASS sometimes have a relationship with children’s school 
readiness outcomes in different domains. When they do, the size of the relationship is small. 


- The Pre-K CLASS assesses teacher-child interactions in a variety of areas, known as domains. 
Instructional Support is the domain whose scores have the greatest relationship to chil- 
dren’s outcomes. Technical assistance to teachers and professional development providers 
focused on this domain could have the most impact for improving children’s outcomes. 


- There is some limited evidence that Pre-K CLASS scores need to reach a certain level to be 
related to children’s outcomes, So more research is needed to determine the appropriate- 
ness of benchmarks for determining quality. 


- A few studies found that Pre-K CLASS scores matter more for some children than others. 
More research is needed to examine the relationships of Pre-K CLASS scores with outcomes 
for children from different backgrounds, and the reasons why findings might differ for 
different groups. 


Introduction Research has revealed that classroom process quality, 


in particular, is related to children's outcomes, espe- 


In early care and education (ECE) settings, the quality cially for children whose families have low incomes 


of a classroom is related to how well children learn or primarily speak a language other than English 
in the home (Yoshikawa et al. 2013). In the past two 


decades, however, studies have generally found that 


and develop (Phillips et al. 2017). In a classroom, 
quality has two dimensions: process quality and 


structural quality. Process quality is especially these relationships are small to modest in strength 


(see Burchinal 2018 and Perlman et al. 2016 for reviews). 
This raises the question of whether there is a level, or 


emotional needs, and cognitive and language threshold, of quality, and above that threshold, quality 
stimulation. These features predict a child's readiness 


important. This type of quality generally focuses on 
sensitive caregiving, responsiveness to children's 


is more strongly related to children's outcomes. If there 


for school better than structural quality measures is a threshold that classrooms need to meet or exceed 


like teacher-child ratios, class size, operating hours, for the children in those classrooms to be well prepared 


classroom materials, and teachers’ credentials (Howes 
et al. 2008; Mashburn et al. 2008; Sabol et al. 2013). 


for school, then the best way to use limited resources 
might be to raise classrooms above that threshold. 


= 
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Description of Pre-K CLASS domains 


The Pre-K CLASS focuses on classrooms serving 
children ages 3 to 5. It assesses classroom 
quality in three broad domains of teacher-child 
interactions: Instructional Support, Emotional 
Support, and Classroom Organization. The 


One widely used tool that captures the process 
quality of preschool classrooms, including 
interactions between teachers and children, is the 
Classroom Assessment Scoring System-Preschool 
(Pre-K CLASS; Pianta et al. 2008). The Bill & Melinda 
Gates Foundation funded Mathematica to conduct 
a literature scan to search for recent studies 
analyzing how well widely used classroom quality 
measures—including the Pre-K CLASS—perform 
(see box at the end of the brief for more details 
about methods). This brief focuses on what we know 
about how the Pre-K CLASS relates to children's 
outcomes in general, and whether its relationships 
with outcomes differs for key subgroups of children. 


By summarizing findings of the most recent studies 
published in the field, we can learn more about 

how and when quality measures relate to children's 
outcomes, the reasons why the strength of those 
relationships might be modest, and if there is the 
need to expand existing measures of quality. We 
conclude with some implications these findings 
have for practice and future research. 


interactions are scored on a 7-point scale, with 
scores of 1 or 2 for low quality interactions, scores 
of 3, 4, or 5 for midrange quality, and scores of 6 
or 7 for high quality. Each domain is designed to 
assess a particular aspect of process quality: 
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Instructional Support 


Quality of instructional practices used in the classroom 


Emotional Support 


Social and emotional functioning in the classroom 


Classroom Organization | Teacher's ability to organize the classroom to make efficient 


use of class time 
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Figure 1. Number of studies reviewed 
(n=27), by type of relationship 


Focused on 
subgroup 
differences 


Focused on 
threshold 
effects 


Focused on 
linear 
relationships 


Key Findings 


Figure 1 shows the number of studies we reviewed 
for this brief. Specifically, out of 27 studies, 25 
focused on whether there were linear relationships 
(see key terms box) between the Pre-K CLASS and 
children's outcomes. Four studies also examined 
whether there were threshold effects above which 
scores have a relationship to better outcomes for 
children. Eight studies highlighted differences 

in classroom quality and in whether children’s 
characteristics (for example, being a dual language 
learner) played a role in the strength or direction 
of the relationship between classroom quality and 
children's outcomes. 


Key terms 


- Linear relationships indicate that as classroom 
quality increases or decreases, the children’s 
scores on an outcome also increase or decrease. 


- Threshold effects suggest that classroom 
quality scores need to reach a certain level 
before we see scores rise on children’s outcomes. 


re 
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Next, we highlight key findings from the studies 
we examined (see Tables A.1 through A.4 in the 
appendix for more details). It is important to keep 
in mind that studies can be done in different ECE 
settings; use different control variables, sample 
sizes, or sample compositions; and use different 
Pre-K CLASS scores. We might therefore find a 
different pattern in the findings from one study to 
the next, even for the same outcome. 


How do the Pre-K CLASS domain 
scores relate to children’s readiness 
for school skills? 


Pre-K CLASS scores were related to children’s 
outcomes in preschool,’ kindergarten, and beyond. 
Those relationships were generally modest, and 
sometimes they were counterintuitive. Some 
studies did not find that scores related to outcomes 
at all. Table 1 shows the number of studies in our 
scan that found a relationship between higher Pre-K 
CLASS scores and better outcomes for children. 


Instructional Support was the Pre-K CLASS domain 
that was most commonly related to children's 
outcomes. It was related to children's outcomes 

in the literacy; language; and social-emotional, 
executive function, and physical domains (Table 1). 
Looking at different outcomes for children, this 
domain was most often related to better literacy 

(for example, Carr et al. 2019; Han et al. 2017; Soliday 
Hong et al. 2019) and language skills (for example, 
Goble and Pianta 2017; Hamre et al. 2014). It was also 
positively related to children’s math skills (Carr et 

al. 2019; Gordon and Peng 2020; and Vitiello et al. 
2018), social skills and self-efficacy (Hestenes et al. 
2015), closeness with their teacher (Hamre et al. 2014), 
executive function (Early et al. 2018; Vitiello et al. 
2018), inhibitory control (Goble et al. 2019; Gordon and 
Peng 2020), and visuomotor outcomes (coordination 
of vision and movement) (Byers et al. 2016). These 
findings from individual studies differ from a meta- 
analysis conducted by Perlman et al. (2016),? which 
found significant but small relationships between 
Instructional Support and social skills, but none 
between Instructional Support and any of the other 
reviewed outcomes (English receptive vocabulary, 
letter-word identification, or math). 
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Table 1. Number of studies in which Pre-K CLASS scores were related to more positive 
child outcomes? 


YoYor f=) 
-Yoave)d io) alt=) 
executive function, 

Pre-K CLASS score |-V ate [Ut-Le [= Literacy re) ane-j (r=) | 
Instructional Support 7 of 12 12 of 14 Sof 10 8 of 13 
Emotional Support lof 10 4 of 12 1of9 5 of 12 
Classroom Organization 2 0f 9 Sof ll 3 of 8 5 of 10 
Other’ 3 0f 4 Sof6 20f5 7of8 


aln individual studies, the patterns of findings were sometimes inconsistent (that is, some relationships were 
significant, whereas others were not; or some alternative scores were significantly related to child outcomes, 
whereas others were not). We only include studies in counts of significant findings when the patterns in those 


studies are in the expected directions. 


’"Other” includes studies that examined a total Pre-K CLASS score (in other words, the average for all three domains) 
or constructed the score in alternative ways, such as combining Emotional Support and Classroom Organization 


domain scores into one score. 


Emotional Support was most often related to 
children's social-emotional, executive function, 

and physical outcomes (Table 1). For example, 

in individual studies, it was positively related to 
approaches to learning (Limlingan et al. 2020), 
executive function (Early et al. 2018; Vitiello et al. 
2018), inhibitory control skills (Hamre et al. 2014), and 
visuomotor outcomes (Byers et al. 2016). A handful of 
studies revealed a relationship between Emotional 
Support and early literacy skills (Soliday Hong et 

al. 2019; Goble and Pianta 2017; Carr et al. 2019; 
Gordon and Peng 2020). Only two studies found a 
relationship between Emotional Support scores and 
children's outcomes in other domains—specifically, 
with children's language outcomes (Soliday Hong et 
al. 2019) or math skills (Schmitt et al. 2020). These 
findings from individual studies differ from those in 
Perlman et al.'s (2016) meta-analysis, which reported 
no significant relationships between Emotional 
Support and any of the reviewed outcomes (executive 
function, social skills, English receptive vocabulary, 
letter-word identification, or math). 
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Classroom Organization was most often related to 
children’s literacy and social-emotional, executive 
function, and physical outcomes (Table 1). In 
individual studies, it was positively related to prelit- 
eracy (Soliday Hong et al. 2019; Vitiello et al. 2018), 
knowledge of letters (Carr et al. 2019; Early et al. 2018; 
Gordon and Peng 2020) and letter sounds (Carr et al. 
2019) skills. It was also related to inhibitory control 
skills (Hamre et al. 2014; Gordon and Peng 2020), 
executive function (Early et al. 2018; Vitiello et al. 
2018), social skills (Early et al. 2018), working memory 
(Hamre et al. 2020), and visuomotor outcomes (Byers 
et al. 2016). In just a handful of studies, Classroom 
Organization was related to children’s outcomes in 
other domains, including math skills (Gordon and 
Peng 2020; Vitiello et al. 2018) and receptive vocabu- 
lary (Carr et al. 2019; Soliday Hong et al. 2019). The 
meta-analysis conducted by Perlman et al. (2016) 
found significant but small relationships between 
Classroom Organization and executive function, 
but—unlike the individual studies we reviewed— 
there were no relationships with any of the other 
reviewed outcomes (social skills, English receptive 
vocabulary, letter-word identification, or math). 
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Do alternative Pre-K CLASS scores relate 
to children’s readiness for school skills? 


Some studies examined the total Pre-K CLASS 
score or constructed alternative Pre-K CLASS 
scores. These scores were most often related to 
outcomes in the literacy and social-emotional, 
executive function, and physical domains. A total 
Pre-K CLASS score (in other words, one that 
averaged the scores of the three domains) was 
positively related to children’s preliteracy, applied 
problems, and executive function skills (Vitiello 

et al. 2018). Soliday Hong and colleagues (2019) 

also examined a total Pre-K CLASS score and 
found modest relationships with two of the four 
outcomes—language and literacy skills—but 

not with math or social skills. Broekhuizen and 
colleagues (2016) examined classroom quality scores 
in pre-K and kindergarten by combining Emotional 
Support and Classroom Organization scores. They 
found that children in higher quality classrooms in 
both years had better social skills in kindergarten 
and fewer behavior problems than children who 
were in a high quality classroom for only one year. 
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Alternative domain scores that included a general 
Responsive Teaching factor in the Pre-K CLASS 
were related to children's outcomes across domains, 
including language, literacy, working memory, 

and teacher-reported conflict (Hamre et al. 2014). 
Gordon and Peng (2020) found relationships 
between alternative domain scores and children’s 
outcomes. For example, a Cognitive Facilitation 
factor was positively related to math scores. 


Are there threshold effects of the 
Pre-K CLASS on children’s readiness 
for school skills? 


There was some limited evidence that the 
relationship between Pre-K CLASS scores and 
children's outcomes was stronger in classrooms 
with higher levels of quality than in classrooms of 
lower quality (Table 2). Burchinal and colleagues 
(2016) found evidence of a threshold in the 
relationship between Instructional Support and 
children's language and literacy scores. Specifically, 
using a score of 2.75 as the threshold cut point, 
Instructional Support was a stronger predictor 

of language and literacy scores in higher quality 


classrooms than in lower quality classrooms. 


Early Childhood Literature Scan Brief 


However, Hatfield and colleagues (2016) did not 
find evidence of threshold effects for Instructional 
Support on children's language skills, print 


knowledge, phonological skills, or inhibitory control. 


Yet they find thresholds in the relationship between 
Emotional Support and Classroom Organization 
and children’s phonological skills and inhibitory 
control. Children demonstrated higher skills in 
both areas in classrooms where Emotional Support 
scores were higher than 6, but these relationships 
were weak or non-existent when they were below 
that threshold. They found similar patterns with 
Classroom Organization scores higher than 6 

and phonological skills and print knowledge. 
Anderson and Phillips (2017) found evidence of 
thresholds above which Emotional Support had 
positive relationships with kindergarten reading 
and math skills. The relationships, however, were 
counterintuitive, with higher skills related to 

lower levels of Emotional Support (in the moderate 
quality—or scores of 5.0 to 5.9—range) rather than 
higher levels. There is inconclusive evidence about 
threshold effects, 

which may be because of small sample sizes when 
splitting the classrooms up by the different cut 
points, limited range of scores, and overall low 
scores in the sample. 


Does the Pre-K CLASS have different 
relationships with children's readiness 
for school skills depending on children's 
background characteristics? 


Classroom quality matters more for some children 
than others. Relationships between Pre-K CLASS 
scores and children's outcomes were stronger 

for native English-speaking children, children 
without individualized education programs (IEPs), 
non-immigrant children, and children in families 
with higher incomes.’ Others found relationships 
between Pre-K CLASS scores and children's 
outcomes—not found with their peers—for boys, 
children in rural and small urban communities, and 
children with stronger self-regulation skills. 


Specific subgroup findings on the relationship 
between Instructional Support and Emotional 
Support scores and outcomes include: 


/ When Instructional Support scores were in the 
low end of the moderate range (that is, scores of 
3 to 4), kindergarten letter-word skills of children 
from higher-income families were not as strong 
as they were when Instructional Support scores 
were higher (Anderson and Phillips 2017). 


Table 2. Number of studies with significant threshold findings for Pre-K CLASS scores 


and child outcomes 


Pre-K CLASS score 


Tate [Ue l=) 


Instructional Support O of 2 
Emotional Support n.a. 
Classroom Organization n.a. 
Other? n.a. 


Literacy 


lof2 


O of 1 


SYoYeod f=) ba 
-Yoae)a io) at-) 
executive function, 

Math re) ay4-j (er) 
Oof2 n.a. O of 1 
O of 1 lof] 
lofi n.a. lof] 
O of 1 O of 1 


ln individual studies, the patterns of findings were sometimes inconsistent (that is, some relationships were 
significant, whereas others were not. We only include studies in counts of significant findings when the patterns in 


those studies are in the expected directions. 


’"Other” includes a study that examined a total Pre-K CLASS score (in other words, the average for all three domains). 
n.a. = not applicable. No studies examined threshold effects for these child outcomes. 
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/ When children were in classrooms with high 


Instructional Support scores, chronic absenteeism 
was related to fewer gains in executive function 
skills (Fuhs et al. 2018). 


/ Classrooms with high scores on Instructional 
Support and Emotional Support had greater bene- 
fits for native English-speaking children (Beecher 
et al. 2018). 


/ Classrooms with high scores on Emotional 
Support had greater benefits for children without 
Individualized Education Plans (IEPs) (Beecher 
et al. 2018). 


/ Higher levels of Emotional Support were nega- 
tively related to boys’ kindergarten math skills 
(Anderson and Phillips 2017). 


Specific subgroup findings related to the total Pre-K 
CLASS scores from our scan include: 


/ Pre-K CLASS scores mattered more for non-immi- 
grant children; in lower quality classrooms these 
children had lower scores on achievement tests 
than immigrant children did (Calzada et al. 2015). 


/ The relationship between Pre-K CLASS scores 
and children's behavioral outcomes differed by 
urbanicity, with one study finding relationships 
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between the two for children in rural or small 
urban communities (and less often for those in 
large urban communities) (Schmitt et al. 2018). 


What implications do the findings 
have for practice and research? 


As many of the reviewed studies point out, users 

of the Pre-K CLASS can expect to find relationships 
between the scores and a range of children's 
outcomes, but these relationships are likely to be 
small or modest in strength. Users interested in 
detecting stronger relationships could consider 
other observation measures, such as domain-specific 
tools (Burchinal 2018; Clements and Sarama 2008), 
although less research has examined these. 


Users of the Pre-K CLASS seeking the most effective 
way to predict child outcomes should carefully 
consider which domains to observe. Although domain 
scores on the Pre-K CLASS link to outcomes across 
the child domains assessed, Instructional Support is 
most consistently related to child outcomes across 
studies. Given this finding, states using the Pre-K 
CLASS may want to focus technical assistance and 
feedback for teachers and professional development 
providers on Instructional Support in particular. 

In addition, Emotional Support and Classroom 
Organization are most consistently associated with 
children's social-emotional, executive function, and 
physical outcomes compared with other outcome 
domains. Executive function and social-emotional 
skills have been shown to be important for eventual 
adult well-being and future success (Carneiro et al. 
2007; Heckman 2006), so technical assistance could 
also focus on how classroom quality can develop and 
improve these skills. Few studies have examined 
threshold effects with the Pre-K CLASS, so more 
research is needed to determine the appropriateness 
of benchmarks for determining quality. 


Pre-K CLASS scores and their relationship to 
children's outcomes can vary depending on the 
characteristics of the children in the classroom. In 
other words, the likelihood that quality scores are 
related to children’s outcomes could be stronger for 
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children with different background characteristics 
and skills. Researchers should continue to examine 
the factors that could help explain why there are 
differential relationships between Pre-K CLASS scores 
and child outcomes. For states, it is important to 
understand the nature and extent of the relationships 
between classroom quality and outcomes for children 


of different backgrounds. As states’ early learning 
systems continue to evolve, this understanding 

could help shape decisions with large financial and 
programmatic consequences—for example, where to 
target resources to improve the quality of classroom 
instruction and teacher-child interactions for children 
who stand to benefit from it the most. 


Literature scan on classroom quality measures 


This brief is one in a series of reporting products 
examining how scores on different classroom 
quality measures relate to children’s readiness 
for school. The larger literature scan this is based 
on focused on studies that examined how 

well classroom quality measures capture what 
they are designed to capture, how they relate 

to children’s outcomes, and issues of equity 
including differences in findings for subgroups of 
children. The goal was to inform the use of these 
classroom quality measures by the ECE field. 
We describe a subset of findings from the larger 
literature scan in this research brief. 


Methods 


We reviewed 27 studies published in the past 
five years. All 27 examined relationships between 
the Pre-K CLASS and child outcomes. We 
focused on research from the past five years 
because one study from Perlman and colleagues 
(2016) summarized findings about the Pre-K 
CLASS and children’s outcomes through 2015. 
We compiled the studies by conducting (1) a 
database search of empirical studies and (2) a 
scan of key websites for recent and ongoing 
research and unpublished literature. Trained 
staff screened the studies and reports found in 
both the database search and website review 
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for their relevance to the subject. We eliminated 
studies that were off topic, conducted outside of 
the United States, published in a language other 
than English, did not appear in a substantive 
publication (for example, we did not include 
press releases, newspaper articles, and opinion 
pieces), or focused on a different population or 
measure (such as use of the CLASS in elementary 
school classrooms). The reviewed studies were 
conducted in a range of ECE settings, primarily 
Head Start and state pre-K classrooms. 


The reviewed studies used a range of analytic 
approaches to determine whether the Pre-K 
CLASS was related to children’s outcomes. For 
example, some studies examined the relationship 
between the two variables without accounting 
for other variables, and others did include 

more variables in their analyses (for example, 

by using regressions) to account for children’s 
characteristics such as gender and race or 
ethnicity. The most rigorous studies accounted 
for children’s skills at the beginning of the 
school year, which allowed the researchers to 
see changes in skills after the year began and 
made it more likely that those changes could be 
attributed to the relationships they found. 
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Endnotes 


1 Unless otherwise specified, outcomes include those 
measured in the preschool year. 


? Authors included 19 studies—all published through July 
2015—in their meta-analyses. The findings of the meta- 
analysis of Perlman et al. (2016) may not bear out the 
findings of individual studies, some of which are included 
in this literature scan. Two reasons for this are that (1) the 
overall relationships between classroom quality and child 
outcomes might be eliminated when aggregating results 
across samples and (2) there is a conservative approach 
to including studies by only summarizing those that were 
very similar to each other in terms of operationalizing the 
CLASS and the various child outcome domains. 


3 Factor analysis groups together variables that focus ona 
similar concept or construct. These factors were derived 
from the data, not from theory. 


* Findings are contrary to what has typically been found 
(i.e., Yoshikawa et al. 2013). These studies speculate some 
reasons for their findings in the individual articles. In 
general, they acknowledge that these findings are difficult 
to interpret. 
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Appendix A 


Detailed findings from studies examining the relationship between the Pre-K CLASS and child outcomes 


Table A.1. Key findings on the relationship between the Pre-K CLASS Instructional Support and child outcomes 


1=X=) F- 1d e) atin} os o)Vae (eo) pal-lia le 


Gain or Linear or SYolei t=] bx=)aakevd(e) at-| P 
cross-sectional id alc=t-) are) (e| =)<-YeiU ia hV{-W Ul avead(o) a 
Citation olUinevolanl=¥4 analysis? Language Literacy” Math re) aves fer= 1} 


Anderson and Phillips 2017 | Gain Linear + (kindergarten n.s. (kindergarten n.s. (kindergarten 
letter-word » middle applied problems) attentiveness) 
school reading)* 
Anderson and Phillips 2017 Gain Threshold n.s. (kindergarten n.s. (kindergarten n.s. (kindergarten 
spelling) applied problems) attentiveness) 
Beecher et al. 2018 Gain* Linear ns. (letter sounds) + (object counting) 
+ (letter naming) n.s. (rote counting) 
Broekhuizen et al. 2016 — Cross-sectional Linear n.s. (kindergarten 
social skills) 
n.s. (kindergarten 
behavior problems) 
n.s. (grade 1 social skills) 
n.s. (grade 1 behavior 
ee eS problems) 
Burchinal et al. 2016 Gain Threshold + (receptive + (letter word) n.s. (applied problems) 
vocabulary) 
Bustamante and Gain Linear + (approaches to + (approaches to + (approaches to 
Hindman 2019 learning » receptive learning > letter word)* | learning = applied 
vocabulary)* + (approaches to problems)* 
learning > spelling skills)* 
Byers et al. 2016 Gain Linear + (visuomotor) 
Carr et al. 2019 Gain Linear + (receptive vocabulary, | + (letter word, phonemic | + (applied problems) 
oral expression) awareness) 
Early et al. 2018 Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | + (executive functioning) 
vocabulary) n.s. (behavior problems) 
n.s. (Social skills) 
Fuhs et al. 2018 Gain Linear n.s. (executive 
functioning) 
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1=X-) Fd oe) atin} os ova (eo) pal-li als 


eF-}ia Ke) ad |TaX=x-1 ace) a SYofei f=] bx=vaaleiaie)at=| A 
(oi fol -Youdl (ol ate] id alc-s1 ate) (e| Tol Vidi mv lalead(o] an 
Citation outcome? analysis? Tate Ut-le (=) Literacy” re) anVeicer=] | 
Goble and Pianta 2017 Gain Linear + (expressive vocabulary) | + (phonological ns. (inhibitory control) 
n.s. (receptive awareness) 
vocabulary) n.s. (print knowledge) 
Goble et al. 2019 Gain Linear ns. (receptive + (print knowledge) n.s. (applied problems) | + (inhibitory control) 
vocabulary) 
Gordon and Peng 2020 = Gain Linear ns. (receptive + (letter word) + (applied + (inhibitory control) 
(using FACES 2009 data) vocabulary) n.s. (spelling) problems) n.s. (attention) 
n.s. (Social skills) 
n.s. (behavior problems) 
Gordon and Peng 2020 = Gain Linear ns. (receptive ns. (letter word) n.s. (inhibitory control) 
(using FACES 2014 data) vocabulary) n.s. (spelling) n.s. (attention) 
n.s. (Social skills) 
n.s. (behavior problems) 
Hamre et al. 2014 Gain Linear + (receptive vocabulary, | + (phonological n.s. (teacher-child 
expressive vocabulary) | awareness, print conflict) 
knowledge) + (teacher-child 
closeness) 
n.s. (working memory) 
ns. (inhibitory control) 
Han et al. 2017 Cross- Linear ns. (receptive n.s. (letter word) 
sectional vocabulary) + (letter sounds) 
n.s. (expressive 
vocabulary) 
Hatfield et al. 2016 Gain Threshold ns. (receptive vocabulary) | ns. (print knowledge) n.s. (inhibitory control) 
n.s. (expressive 
vocabulary) 
n.s. (phonological 
awareness) 
Hestenes et al. 2015 Cross- Linear + (social skills) 
sectional + (learning self-efficacy) 
n.s. (externalizing 
problems) 
ns. (internalizing 
problems) 
Hindman and Wasik 2015 | Gain Linear + (English receptive 
vocabulary) 
+ (Spanish receptive 
vocabulary) 
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1=X-) Fd oe) atin} os ova (eo) pal-li als 


eF-}ia Ke) ad |TaX=x-1 ace) a SYofei f=] bx=vaaleaie)at-| A 
cross-sectional id alc=t-) avo) (e| executive function, 

Citation outcome? analysis? Tate Ut-\e{=) Literacy” re) anveicer=] | 
Mashburn et al. 2016° Gain Linear n.s. (narrative language) | ns. (print knowledge) 

+ (definitional ns. (alphabet 

vocabulary) knowledge) 

+ (phonological n.s. (print concepts) 

awareness) 
Mashburn et al. 2016° Gain Linear ns. (narrative language) | + (print knowledge) 

n.s. (definitional + (alphabet knowledge) 

vocabulary) + (print concepts) 

n.s. (phonological 

awareness) 
Perlman et al. 2016 Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | + (Social skills) 

vocabulary) 
Schmitt et al. 2020 Cross-sectional Linear n.s. (applied problems) 
Soliday Hong et al. 2019 (Gain Linear + (receptive vocabulary) | + (preliteracy) ns. (applied problems, | ns. (Social skills, 

quantitative concepts) | behavior problems) 

Vitiello et al. 2018 (local = Gain Linear + (preliteracy) + (applied problems, + (executive functioning) 
staff observations) quantitative concepts) 
Vitiello et al. 2018 Gain Linear ns. (preliteracy) n.s. (applied problems, | ns. (executive 
(research staff quantitative concepts) | functioning) 
observations) 


Note: Outcomes/domains that were not examined are represented by blank cells. Unless otherwise noted, the outcomes examined were measured in preschool. 


For studies that conducted a linear analysis, + indicates that classroom quality had a positive relationship with the respective child outcome(s); — indicates that classroom quality had a 
negative relationship with the respective child outcome(s); n.s. = indicates no evidence of a significant relationship between classroom quality and the respective child outcome(s). 


For studies that conducted a threshold analysis, + indicates that higher levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); — indicates 
that lower levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); n.s. = indicates no evidence of a threshold of quality above or below which 
the respective child outcome(s) were related to classroom quality. 


* Denotes that the study examined gains by using change scores. Otherwise, gains were examined by controlling for a previous score. 
? Measures listed together in the same set of parentheses were examined together as a composite. 


> Preliteracy refers to a composite of skills, including expressive vocabulary, receptive vocabulary, phonological awareness, print knowledge, and/or letter-word identification. Studies 
included either a subset or all of these skills in their composite. 


© Finding is based on an indirect relationship. 

4 These analyses focused on the Language Modeling dimension of Instructional Support. 
© These analyses focused on the Literacy Focus dimension of Instructional Support. 
FACES = Head Start Family and Child Experiences Survey. 
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Table A.2. Key findings on the relationship between the Pre-K CLASS Emotional Support and child outcomes 


Citation 


Anderson and Phillips 
2017 


eF)ia Ke) d 
cross-sectional 
(ol Ui Kexo)ant=¥4 


Gain 


Linear or 
id ay c=s-Jave)(e| 
analysis? 


Linear 


|=] ale [Ur-lel=) 


1=X=) Fd (oe) atin} es o)Vae (eo) pal-lia ls 


Literacy? 


n.s. (kindergarten letter 
word) 
ns. (kindergarten 


spelling) 


Math 


ns. (kindergarten 
applied problems) 


SYofei t=] bx=)aatevd(e) at-| P 
executive function, 
fe) a\¥p-1 (er) | 


ns. 
(kindergarten 
attentiveness) 


Anderson and Phillips Gain Threshold - (kindergarten letter - (kindergarten applied ns. (kindergarten 
2017 word) problems) attentiveness) 
ns. (kindergarten 
spelling) 
Beecher et al. 2018 Gain* Linear ns. (letter sounds) n.s. (object counting) 
ns. (letter naming) n.s. (rote counting) 
Burchinal et al. 2016 Gain Threshold n.s. (behavior problems) 
n.s. (social skills) 
Byers et al. 2016 Gain Linear + (visuomotor) 
Carr et al. 2019 Gain Linear n.s (receptive vocabulary, | + (letter word, phonemic |n.s. (applied problems) 
oral expression) awareness) 
Early et al. 2018 Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | + (executive 
vocabulary) functioning) 
n.s. (behavior 
problems) 
n.s. (social skills) 
Goble and Pianta 2017 Gain Linear n.s. (expressive + (phonological ns. (inhibitory control) 
vocabulary) awareness) 
ns. (receptive n.s. (print knowledge) 
vocabulary) 
Goble et al. 2019 Gain Linear ns. (receptive ns. (print knowledge) ns. (inhibitory control) 
vocabulary) 
Gordon and Peng 2020 = Gain Linear ns. (receptive + (letter word) n.s. (applied problems) ns. (inhibitory control) 
(using FACES 2009 data) vocabulary) ns. (spelling) n.s. (attention) 
n.s. (social skills) 
n.s. (behavior problems) 
Gordon and Peng 2020 = Gain Linear n.s. (receptive n.s. (letter word) n.s. (applied problems) | n.s. (inhibitory control) 


(using FACES 2014 data) 
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vocabulary) 


n.s. (spelling) 


n.s. (attention) 
n.s. (social skills) 
n.s. (behavior problems) 
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Citation 


eF-)ia Ke) a 
cross-sectional 
(olU | Karola at =¥a 


|Tat=x-1 ace) a 
id al c=s-Jave)(e| 
analysis? 


Tale lUt-ve[=) 


1=X-) Fd (oe) atin} os el\Vae fe) pal-lials 


Literacy? 


SYofei f=] bx=)aatedie)at-| A 
executive function, 
rel anveicer=] | 


Hamre et al. 2014 Gain Linear n.s. (receptive n.s. (phonological n.s. (teacher-child 
vocabulary, expressive | awareness, print conflict) 
vocabulary) knowledge) n.s. (teacher-child 
closeness) 
n.s. (working memory) 
- (inhibitory control) 
Han et al. 2017 Cross-sectional Linear n.s. (receptive n.s. (letter word) 
vocabulary) n.s. (letter sounds) 
n.s. (expressive 
vocabulary) 
Hatfield et al. 2016 Gain Threshold ns. (receptive ns. (print knowledge) + (inhibitory control) 
vocabulary) 
n.s. (expressive 
vocabulary) 
+ (phonological 
awareness) 
Hestenes et al. 2015 Cross-sectional Linear n.s. (Social skills) 
ns. (learning self-efficacy) 
ns. (externalizing 
problems) 
+ (internalizing problems) 
Limlingan et al. 2020 Gain Linear ns. (receptive + (approaches to 
vocabulary) learning) 
n.s. (Spanish receptive n.s. (cooperative 
vocabulary) behavior) 
Perlman et al. 2016 Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) _n.s. (Social skills) 
vocabulary) n.s. (executive 
functioning) 
Schmitt et al. 2020 Cross-sectional Linear + (applied problems) 
Soliday Hong et al. 2019 Gain Linear + (receptive vocabulary) | + (preliteracy) n.s. (applied problems, ns. (Social skills, behavior 
| quantitative concepts) | problems) 
Vitiello et al. 2018 (local Gain Linear n.s. (preliteracy) n.s. (applied problems, | ns. (executive 
staff observations) quantitative concepts) — functioning) 
Vitiello et al. 2018 Gain Linear ns. (preliteracy) n.s. (applied problems, + (executive functioning) 


(research staff 
observations) 


quantitative concepts) 


Note: Outcomes/domains that were not examined are represented by blank cells. Unless otherwise noted, the outcomes examined were measured in preschool. 


For studies that conducted a linear analysis, + indicates that classroom quality had a positive relationship with the respective child outcome(s); — indicates that classroom quality had a 
negative relationship with the respective child outcome(s); n.s.= indicates no evidence of a significant relationship between classroom quality and the respective child outcome(s). For 
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studies that conducted a threshold analysis, + indicates that higher levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); — indicates that 
lower levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); n.s. = indicates no evidence of a threshold of quality above or below which the 
respective child outcome(s) were related to classroom quality. 


* denotes that the study examined gains by using change scores. Otherwise, gains were examined by controlling for a previous score. 
® Measures listed together in the same set of parentheses were examined together as a composite. 


© Preliteracy refers to a composite of skills, including expressive vocabulary, receptive vocabulary, phonological awareness, print knowledge, and/or letter-word identification. Studies 
included either a subset or all of these skills in their composite. 


FACES = Head Start Family and Child Experiences Survey. 


Table A.3. Key findings on the relationship between the Pre-K CLASS Classroom Organization and child outcomes 


1=X-) F- 1d fe) atin} es o)Vae (eo) pal-liale 


fer} laKeyg Linear or psYofei f=] aaveld(e)ar-1 
cross-sectional id alc=t- avo) (e| =)<-YoiU i a\V{-W 10 avead(o) an 
Citation outcome? analysis? Tale LU re [-) Literacy® Math rela\yeaiter] | 
Beecher et al. 2018 Gain* Linear + (letter sounds) + (object counting) 
+ (letter naming) n.s. (rote counting) 
Byers et al. 2016 Gain Linear + (visuomotor) 
Carr et al. 2019 Gain Linear + (receptive vocabulary, |+ (letter word, n.s. (applied problems) 
oral expression) phonemic awareness) 
Early et al. 2018 Gain Linear n.s. (receptive n.s. (letter word) n.s. (applied problems) | + (executive functioning) 
vocabulary) n.s. (behavior problems) 
+ (social skills) 
Goble and Pianta 2017 Gain Linear n.s. (expressive n.s. (phonological n.s. (inhibitory control) 
vocabulary) awareness) 
n.s. (receptive n.s. (print knowledge) 
vocabulary) 
Goble et al. 2019 Gain Linear ns. (receptive n.s. (print knowledge) n.s. (inhibitory control) 
vocabulary) 
Gordon and Peng 2020 = Gain Linear n.s. (receptive + (letter word) n.s. (applied problems) | + (inhibitory control) 
(using FACES 2009 data) vocabulary) n.s. (Spelling) n.s. (attention) 
n.s. (Social skills) 
n.s. (behavior problems) 
Gordon and Peng 2020 = Gain Linear n.s. (receptive n.s. (letter word) + (applied problems) n.s. (inhibitory control) 
(using FACES 2014 data) vocabulary) n.s. (Spelling) n.s. (attention) 
n.s. (Social skills) 
n.s. (behavior problems) 
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Citation 


eF-)ia Ke) a 


cross-sectional 
(ol U | Kexo)aat=¥a 


|Tat=x-1 ace) a 
id al c=s-Jave)(e| 
analysis? 


Tale lUt-ve[=) 


1=X-) Fd oe) atin} os hae) pal-lials 


Literacy? 


SYofoi f=] bx=vaateaie)at=| A 


executive function, 
rel anveicer=] | 


Hamre et al. 2014 Gain Linear ns. (receptive n.s. (phonological n.s. (teacher-child 
vocabulary, expressive | awareness, print conflict) 
vocabulary) knowledge) n.s. (teacher-child 
closeness) 
+ (working memory) 
+ (inhibitory control) 
Han et al. 2017 Cross-sectional Linear ns. (receptive n.s. (letter word) 
vocabulary) n.s. (letter sounds) 
n.s. (expressive 
vocabulary) 
Hatfield et al. 2016 Gain Threshold ns. (receptive + (print knowledge) n.s. (inhibitory control) 
vocabulary) 
n.s. (expressive 
vocabulary) 
+ (phonological 
awareness) 
Hestenes et al. 2015 Cross-sectional Linear n.s. (Social skills) 
ns. (learning self-efficacy) 
n.s. (externalizing 
problems) 
ns. (internalizing 
problems) 
Perlman et al. 2016 Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | n.s. (Social skills) 


vocabulary) 


+ (executive functioning) 


Schmitt et al. 2020 
Soliday Hong et al. 2019 


Cross-sectional 


Gain 


Linear 


Linear 


+ (receptive vocabulary) 


+ (preliteracy) 


n.s. (applied problems) 


n.s. (applied problems, 
quantitative concepts) 


n.s. (Social skills, behavior 
problems) 


Vitiello et al. 2018 (local 
staff observations) 


Gain 


Linear 


+ (preliteracy) 


+ (applied problems, 
quantitative concepts) 


n.s. (executive 
functioning) 


Vitiello et al. 2018 
(research staff 
observations) 


Gain 


Linear 


+ (preliteracy) 


n.s. (applied problems, 
quantitative concepts) 


+ (executive functioning) 


Note: Outcomes/domains that were not examined are represented by blank cells. Unless otherwise noted, the outcomes examined were measured in preschool. 

For studies that conducted a linear analysis, + indicates that classroom quality had a positive relationship with the respective child outcome(s); — indicates that classroom quality had a 
negative relationship with the respective child outcome(s); n.s. = indicates no evidence of a significant relationship between classroom quality and the respective child outcome(s). 

For studies that conducted a threshold analysis, + indicates that higher levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); — indicates 
that lower levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); n.s. = indicates no evidence of a threshold of quality above or below which 
the respective child outcome(s) were related to classroom quality. 
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* denotes that the study examined gains by using change scores. Otherwise, gains were examined by controlling for a previous score. 


® Measures listed together in the same set of parentheses were examined together as a composite. 


© Preliteracy refers to a composite of skills, including expressive vocabulary, receptive vocabulary, phonological awareness, print knowledge, and/or letter-word identification. Studies 
included either a subset or all of these skills in their composite. 


FACES = Head Start Family and Child Experiences Survey. 


Table A.4. Key findings on the relationship between the Pre-K CLASS alternative factors and child outcomes 


(eF-}lake) mel coys-o 


MT at=x-1 ace) a 


/=X-¥F-|d(o) at=j al] osm onvme(oleat-llais 


SYorei [=] br=1a ave) d(e) at-] B 


yN i =Yaat=\aiVi=) -Yeid(e)at-)| id al c=t-) ato) (e| executive function, 
Lileivelg Citation outcome? analysis? Language Literacy” rolanvet(er=]| 
Combined Broekhuizen Cross- Linear + (kindergarten social skills) 
Emotional et al. 2016 sectional - (kindergarten behavior 
Support and problems) 
Class-room + (grade 1 social skills) 
Organization - (grade 1 behavior problems) 

Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 

Peng 2020 vocabulary) ns. (Spelling) n.s. (attention) 

(using FACES n.s. (Social skills) 

eee a Ps ___ pe rrawionereBlems)e_— 

Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 

Peng 2020 vocabulary) n.s. (Spelling) n.s. (attention) 

(using FACES n.s. (Social skills) 

2014 data) n.s. (behavior problems) 
Total Bustamante Cross- Linear + (percentage of child- + (child engagement) 

et al. 2018 sectional to-teacher talk) 

Calzada Gain* Linear + (kindergarten reading) | n.s. (kindergarten math) 

et al. 2015 ns. (grade 2 reading) n.s. (grade 2 math) 

Gordon and Gain Linear ns. (receptive + (letter word) n.s. (applied problems) | n.s. (inhibitory control) 

Peng 2020 vocabulary) ns. (spelling) n.s. (attention) 

(using FACES n.s. (Social skills) 

2009 data) n.s. (behavior problems) 

Gordon and Gain Linear n.s. (receptive n.s. (letter word) n.s. (applied problems) | ns. (inhibitory control) 

Peng 2020 vocabulary) n.s. (spelling) n.s. (attention) 

(using FACES n.s. (Social skills) 

2014 data) n.s. (behavior problems) 


FEBRUARY 2021 > mathematica.org 


Early Childhood Literature Scan Brief 


=<) F-1afe)ak-iall e<m o\Vaelelaat-lials 


SYoYei [=] br=1a avo) d(e) at=] 5 
=)'(-\elU i \-m Ul avead(e) ap 
re) ani fer=] | 


|MTat=x-1 ace) 
id al c=s-1ave)(e| 
analysis? 


(eF-}la ke) mel cose 
-Yeid fo) at-)| 
(ol Ui Kexo)ant=¥4 


Alternative 


factor Citation Math 


Literacy” 


BT ale[Utye[=) 


Purtell and Gain Linear n.s. (preliteracy) n.s. (applied problems, | + (social skills) 

Ansari 2018 quantitative concepts) | n.s. (behavior problems) 

(using a sample 

of 3-year-old 

children only) 

Purtell and Gain Threshold n.s. (preliteracy) n.s. (applied problems, | n.s. (Social skills) 

Ansari 2018 quantitative concepts) /n.s. (behavior problems) 

(using a sample 

of 3-year-old 

children only) 

Purtell and Gain Linear n.s. (preliteracy) n.s. (applied problems, | n.s. (Social skills) 

Ansari 2018 quantitative concepts) | n.s. (behavior problems) 

(using a sample 

of 4-year-old 

children only) 

Purtell and Gain Threshold n.s. (preliteracy) n.s. (applied problems, | n.s. (social skills) 

Ansari 2018 quantitative concepts) n.s. (behavior problems) 

(using a sample 

of 4-year-old 

children only) 

Schmitt Cross- Linear + (social competence) 

et al. 2018 sectional n.s. (externalizing behavior, 

internalizing behavior) 

Soliday Hong Gain Linear + (receptive vocabulary) | + (preliteracy) n.s. (applied problems, | n.s. (Social skills, behavior 

et al. 2019 quantitative concepts) | problems) 

Vitiello et Gain Linear n.s. (preliteracy) + (applied problems, + (executive functioning) 

al. 2018 quantitative concepts) 

(research staff 

observations) 
General Gordon and Gain Linear ns. (receptive + (letter word) ns. (applied problems) | ns. (inhibitory control) 
Responsive |Peng 2020 vocabulary) n.s. (spelling) n.s. (attention) 
Teaching (using FACES n.s. (Social skills) 

2009 data) n.s. (behavior problems) 

Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 

Peng 2020 vocabulary) n.s. (spelling) n.s. (attention) 

(using FACES n.s. (social skills) 

2014 data) n.s. (behavior problems) 
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Alternative 


(ef }lake) mel cose 
-Yei d fe) at) | 


|Tat=x-1 ace) 
id al c=s-Jave)(e| 


=<) Fate) al-iall es o\Vaelelaat-lials 


SoYei [=] Pr=1a avo) d(e) at=] 5 
=)'(-YeiU i \V-m 10 avead(e) ap 


LiTeikelg Citation outcome? analysis? E-Tate [UT-te.=) Literacy? physical 
Hamre et al. Gain Linear + (receptive vocabulary, | + (phonological - (teacher-child conflict) 
2014 expressive vocabulary) | awareness, print n.s. (teacher-child closeness) 
knowledge) + (working memory) 
n.s. (inhibitory control) 
Cognitive Gordon and Gain Linear - (receptive vocabulary) | ns. (letter word) n.s. (applied problems) | + (inhibitory control) 
Facilitation Peng 2020 n.s. (spelling) ns. (attention) 
(using FACES n.s. (Social skills) 
2009 data) n.s. (behavior problems) 
Gordon and Gain Linear ns. (receptive n.s. (letter word) + (applied problems) n.s. (inhibitory control) 
Peng 2020 vocabulary) n.s. (Spelling) n.s. (attention) 
(using FACES n.s. (Social skills) 
2014 data) n.s. (behavior problems) 
Hamre et al. Gain Linear + (receptive vocabulary, | + (phonological n.s. (teacher- child conflict) 
2014 expressive vocabulary) | awareness, print ns. (teacher- child closeness) 
knowledge) n.s. (working memory) 
n.s. (inhibitory control) 
Proactive Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 
Management | Peng 2020 vocabulary) n.s. (spelling) ns. (attention) 
and Routines | (using FACES n.s. (Social skills) 
2009 data) n.s. (behavior problems) 
Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | - (inhibitory control) 
Peng 2020 vocabulary) n.s. (spelling) + (attention) 
(using FACES n.s. (social skills) 
2014 data) n.s. (behavior problems) 
Hamre et al. Gain Linear n.s. (receptive n.s. (phonological n.s. (teacher-child conflict) 
2014 vocabulary, expressive | awareness, print n.s. (teacher-child closeness) 
vocabulary) knowledge) n.s. (working memory) 
+ (inhibitory control) 
Climate and | Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 
Management | Peng 2020 vocabulary) n.s. (attention) 
(using FACES n.s. (Social skills) 
2009 data) n.s. (behavior problems) 
Gordon and Gain Linear n.s. (receptive n.s. (letter word) n.s. (applied problems) | n.s. (inhibitory control) 
Peng 2020 vocabulary) n.s. (spelling) n.s. (attention) 
(using FACES n.s. (Social skills) 
2014 data) n.s. (behavior problems) 
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=<) F-1afe)at-iall es< o\Vaelelaat-lials 


(eF-} ake) mel coy mn Mla =3-] ako) g SoYei [=] Pr=1a avo) d(e) at=] 5 

Alternative 7-Yei d(e) at) | ital c=t-) avo) (e| =)-(-\elU i 4\-m WU avead(e) a 
Licyeikeyg Citation olUinevolanl=¥4 analysis? B-Tave[Ul-\e f=) Literacy” Math re) aVeicer=] | 
Sensitivity Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 
and Regard |Peng 2020 vocabulary) n.s. (spelling) n.s. (attention) 

(using FACES n.s. (social skills) 

2009 data) n.s. (behavior problems) 

Gordon and Gain Linear ns. (receptive ns. (letter word) n.s. (applied problems) | ns. (inhibitory control) 

Peng 2020 vocabulary) n.s. (Spelling) n.s. (attention) 

(using FACES n.s. (Social skills) 

2014 data) - (behavior problems) 


Note: Outcomes/domains that were not examined are represented by blank cells. Unless otherwise noted, the outcomes examined were measured in preschool. 


For studies that conducted a linear analysis, + indicates that classroom quality had a positive relationship with the respective child outcome(s); — indicates that classroom quality had a 
negative relationship with the respective child outcome(s); n.s. = indicates no evidence of a significant relationship between classroom quality and the respective child outcome(s). 


For studies that conducted a threshold analysis, + indicates that higher levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); — indicates 
that lower levels of classroom quality had a stronger, positive relationship with the respective child outcome(s); n.s. = indicates no evidence of a threshold of quality above or below which 
the respective child outcome(s) were related to classroom quality. 


* denotes that the study examined gains by using change scores. Otherwise, gains were examined by controlling for a previous score. 
® Measures listed together in the same set of parentheses were examined together as a composite. 


> Preliteracy refers to a composite of skills, including expressive vocabulary, receptive vocabulary, phonological awareness, print knowledge, and/or letter word identification. Studies 
included either a subset or all of these skills in their composite. 


FACES = Head Start Family and Child Experiences Survey. 
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